Evolutionary tuning of multiple SVM parameters
نویسندگان
چکیده
We consider the problem of choosing multiple hyperparameters for support vector machines. We present a novel, general approach using an evolution strategy (ES) to determine the kernel from a parameterized kernel space and to control the regularization. We demonstrate on benchmark datasets that the ES improves the results achieved by grid search and can handle much more kernel parameters. In particular, we optimize generalized Gaussian kernels with arbitrary scaling and
منابع مشابه
Clustering via Support Vector Machine Boosting with Simulated Annealing
SVMs are shown to be effective at clustering when used with metaheuristics to recover label information in a bootstrap learning process. An automated tuning solution for Support Vector Machine (SVM) classification and clustering methods is described. This is shown for two complemetary situations: (1) by implementing a simulated annealing with perturbation tuning procedure on the relabeler-SVM b...
متن کاملTuning SVM parameters by using a hybrid CLPSO-BFGS algorithm
Parameter settings of support vector machine (SVM) have a great influence on its performance. Grid search combining with cross-validation and numerical methods by minimizing some generalization error bounds are two usually adopted methods to tune the multiple parameters in SVM. However, the grid search is often time-consuming, especially when dealing with multiple parameters while the hybrid st...
متن کاملAn Approach to Reducing Overfitting in FCM with Evolutionary Optimization
Fuzzy clustering methods are conveniently employed in constructing a fuzzy model of a system, but they need to tune some parameters. In this research, FCM is chosen for fuzzy clustering. Parameters such as the number of clusters and the value of fuzzifier significantly influence the extent of generalization of the fuzzy model. These two parameters require tuning to reduce the overfitting in the...
متن کاملA nested heuristic for parameter tuning in Support Vector Machines
The default approach for tuning the parameters of a Support Vector Machine (SVM) is a grid search in the parameter space. Different metaheuristics have been recently proposed as a more efficient alternative, but they have only shown to be useful in models with a low number of parameters. Complex models, involving many parameters, can be seen as extensions of simpler and easy-to-tune models, yie...
متن کاملMultiple Parameter Selection for LS-SVM Using Smooth Leave-One-Out Error
In least squares support vector (LS-SVM), the key challenge lies in the selection of free parameters such as kernel parameters and tradeoff parameter. However, when a large number of free parameters are involved in LS-SVM, the commonly used grid search method for model selection is intractable. In this paper, SLOO-MPS is proposed for tuning multiple parameters for LS-SVM to overcome this proble...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Neurocomputing
دوره 64 شماره
صفحات -
تاریخ انتشار 2004